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ABSTRACT 

In this work, we present the problem of rash driving 
detection algorithm using a single wide angle cam¬ 
era sensor, particularly useful in the Indian context. 
To our knowledge this rash driving problem has not 
been addressed using Image processing techniques 
(existing works use other sensors such as accelerom¬ 
eter). Car Image processing literature, though rich 
and mature, does not address the rash driving prob¬ 
lem. In this work-in-progress paper, we present the 
need to address this problem, our approach and our 
future plans to build a rash driving detector. 

Categories and Subject Descriptors 

H. 4.3 [Information Systems Applications]: [Communi¬ 
cations Applications] 

General Terms 

ADAS,Camera sensor,Image analysis 

Keywords 

Rash Driving detection, Autonomous Driving 

I. INTRODUCTION 

India is one of the most accident prone country, where ac¬ 
cording to the NCRB report 135,000 died in 2013 and prop¬ 
erty damage of worth $ 20 billion I I. Many a time, accidents 
and unusual traffic congestion take place due to careless and 
impatient nature of drivers. In most cases drivers don’t fol¬ 
low lane rules, traffic rules leading to traffic congestion and 
accidents. Taking effective measure on traffic situation [5, 
[2 and driver behaviour [l5] can prevent accidents and con¬ 
gestion. 
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A developing country like India needs an effective traffic 
monitoring and management system. Towards this we pro¬ 
pose a visual-analysis-based driving behaviour monitoring 
system. The visual analysis includes the acceleration, lane¬ 
changing, and distance-maintaining behaviour (both from a 
near-by car and pedestrians). To enhance traffic safety, mak¬ 
ing road accident and congestion free, cab companies includ¬ 
ing government and private can adapt our system. Public 
transportation department can install this system in buses 
and other vehicles and in traffic junction for monitoring. 

In developed countries like U.S.A, with the gradual emer¬ 
gence of autonomous driving research, efforts are on to build 
a smart driving system that can drive more safely without 
any fatigue, as compared to humans can be programmed to 
follow traffic rules. Even for these automatic cars, modelling 
self-driving behavior by considering distances of surrounding 
cars and detecting pedestrians is very relevant. 

In this work, we use a single wide angle camera sen¬ 
sor for capturing surrounding environment for visual anal¬ 
ysis of other drivers behaviour and detecting nearby ob¬ 
stacles. From this data, informative features namely fast 
side-ways and forward acceleration, wrong direction driv¬ 
ing, frequent lane changing, getting-close-to-other-cars-and- 
pedestrians behavior are computed by using visual analysis 
techniques. From this collection of features, rash driving 
behavior can be detected. In Figure 1 we have depicted 
different possible scenarios for rash driving detection using 
camera on different infrastructures. 



Figure 1: Rash driving Scenarios 

The solution to the problem of rash-driving detection us¬ 
ing visual analysis is a novel contribution (as compared to 
17]). Also, it is a socially-relevant problem in the Indian 
context. So far, we have defined and extracted the relevant 
visual features on publicly available datasets. We have col¬ 
lected a small sample of data in the city of Bangalore for 












some intial experiments. In the future, we plan to record 
more videos by tieing-up with professional drivers to collect 
a new dataset, to test and advance this initial approach. We 
also plan to work with government agencies who are inter¬ 
ested in sharing the data of traffic junctions in Bangalore. 


2. RELATED WORK 

The related literature can be classified into three cate¬ 
gories. First, the works on Image Processing and Computer 
Vision using single or multiple camera facing the road. Sec¬ 
ond, driver behaviour understanding using a camera facing 
the driver. Finally, a limited literature on rash-driving, al¬ 
beit not using Image Processing. 

In the first category, we have works on advanced driver 
assistance system, traffic safety, autonomous vehicle naviga¬ 
tion and driver behaviour modelling using mutiple cameras, 
LIDAR, RADAR sensor etc. These works focus on using im¬ 
age processing and learning based method for lane detection, 
road segmentation, traffic signs detection and recognition, 
3D modelling of road environment (e.g. Paral¬ 

lax flow computation was used by Baehring et al. for detect¬ 
ing overtaking and close cutting vehicles [ 2 ]. For detecting 
and avoiding collison, Hong et al. had used Radar, LIDAR, 
camera and omnidirectional camera repectively [5j [I] . They 
focused on detecting using LIDAR sensor data classifying 
object as static and dynamic and tracking using extended 
Kalman filter and for getting a wide view of surrounding 
situation. For detection of forward collision Srinivasa et al. 
have used forward looking camera and radar data 17 . 

Regarding the second and third category, the literature 
is fairly limited. In some works driver inattentiveness was 
modelled using fatigue detection, drowsiness, eye tracking, 
cell phone usage etc. Ji et al.[l3] presented tracking method 
for eye, gaze and face pose and Hu et al.[l2] used SVM 
based method for driver drosiness detection . Trivedi et al 
modelled driver behavior using head movements for detect¬ 
ing driver gaze and distraction, targetting adavanced driver 
safety 19 20 . Using accelerometer and orientation sensor 


data [71, rash driving warning system was developed as a 
mobile application. 


3. CHARACTERIZING RASH DRIVING 

Rash drivers generally tend to accelerate quickly side-ways 
and in forward direction. They change lanes frequently and 
get dangerously close to others vehicles and people. In this 
section we describe our rash driving estimation algorithm, 
as visualized in Fig. [2]. From video we take two consecutive 
frames for extracting features. This features will acts as 
a input for rash driving algorithm which will be based on 
thresholding of features values. If rash driving detected we 
will extract number plate of the car, otherwise will run this 
algorithm for next consecutive frames. 

3.1 Fast side-ways and forward Acceleration 

Rapid acceleration also contributes to rash driving. By 
computing optical flow we can estimate horizontal and ver¬ 
tical flow change of road environment. Frequent change in 
horizontal flow in the regions of detected cars result of rash 
lane changing and vertical flow change can give knowledge 
about relative velocity change of test car with respect to 
surrounding cars. From optical flow of surrounding region 
we predict the rash behaviour of other cars. The exact pro- 



Figure 2: Our rash driving detection algorithm 


cedure for computing the discrete flow is described below. 

3.1.1 Discrete Flow Computation 
Optical flow is a measure of pixel velocity in two frame 
of a video. Below we have presented objective function for 
optical flow [18] computation. 

E{u,v) = ^ ~^pD{h{i ,)) -hii + UijJ + Vij) 

ij ( 1 ) 

T Ps{v>i,§ l) 

+ Ps(Vi,j ~ l,j) + Ps(Vi,j ~ Vi,j + 1)] 

where u and v are respectively horizontal and vertical com¬ 
ponent of velocity for frame ii and / 2 ,A is a regularization 
parameter based on expected smoothness of the flow field 
and pd, p s are two functions. Values of u and v are calcu¬ 
lated by optimizing E(u,v) term. 

3.2 Wrong direction driving 

In Indian conditions, vehicles coming in wrong direction 
is also another frequent case of rash driving or rather nui¬ 
sance. Wrong direction driving is easily estimated by ob¬ 
serving anomolies in optical flow in lanes. 

3.3 Frequent lane change detection 

Another characteristic of rash drivers is frequent lane chang¬ 
ing. We have used a robust illuminant invariant lane detec¬ 
tion system in our work using inverse perspective projection 
3] and cubic interpolation with RANSAC curve fitting 10|. 

We have assumed a parabolic road model. From road lane 
fitting, relative position of other vehicles with respect to 
lanes can be estimated. Also from our lane detection algo¬ 
rithm, deperture angle of test car from current lane can be 
computed. 

We have used Lab color space for seperating color and illu¬ 
minant part of images for better detection of lane lines using 
2nd adn 4th order steerable filters. In Fig. [4] we presented 
camera setup and assumed road model. 

3.4 Driving-close-to-vehicles and people-in-front 
behaviour 
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OPTICAL FLOW IN TRAFFIC JUNCTION 


used HOG feature based deformable part model for detect¬ 
ing and locating other cars and pedestrians with respect to 
lane lines. For detecting and locating object in image we 
wil use pyramid based template matching method, where 
we train car and person model using deformable part model 
9, 8] based on HOG [6] feature. This method can detect 
car and people very efficiently under occlusion also. Latent 
SVM trained model is shown in Fig. [6]; and detected car and 
people is shown in Fig.[7] (Reference for the images [ll]). 



OPTICAL FLOW IN BUSY ROAD 


Figure 3: Optical flow characteristics 




Figure 4: Camera setup and Road model 



Figure 5: Lane detection algorithm result 


Not maintaining a proper distance from nearby cars or 
people in pedestrains is also a facet of rash-driving. We have 



Figure 7: Car and person detected using above de¬ 
ferable model 


3.4.1 Pinhole Camera Model 

For determining distance of obstacle from test car we will 
use pinhole camera model, this model can give good accu¬ 
racy for object in front of test car. From error analysis we 
set different offset for approximately measuring distance. 

If a 3D point P= (u, v, w) T and its pinhole projected point 


is I p = (x, y) T 
tion 


there relation 


16 


is given by following equa- 
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where intrinsic matrix A is given by 
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Rotation matirix of camera can be given by 
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Finally, employing all the features described, we make a 
estimate of rash-driving. For now, our proposed system is 
rule-based. In the future, we will collect samples with and 
without rash driving, using professional drivers. Using a 
generative machine learning approach, we can build a prob¬ 
abilistic model to predict rash-driving. We are also consid¬ 
ering recording data with naive volunteers, and manually 
annotating parts of the data where rash-driving tendencies 
are seen, so as to validate the model. 


4. CONCLUSIONS 

In this paper we have described a visual analyis method to 
characterize driving behavior, with a specie focus on rash¬ 
driving. Our algorithm is based on calibrated single camera 
images. The methods are general enough to work on cameras 
placed on cars as well as on infrastructure. In the future, we 
plan to integrate this module with the automatic number 
plate detection and recognition module (as in [l4]) for a 
traffic monitoring application. Though our work is ongoing 
and preliminary, we believe such a system can have a good 
societal impact. As described in Section 1 Introduction, we 
will record a rash-driving dataset in Indian conditions, and 
test our methods. We will also make a requirements study 
with government agencies. 
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